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ABSTRACT • ; 

Presented is a study of eighth- grade students' 
academic problem-solving ability based on their knowledge structures, 
or their information stored in semantic or long-term memory. The 
authors describe a technigue that they developed to probe knowledge 
structures with an- eictension of the card-sort method. The method, 
known as. the Co^icept Structure Analysis Technique (ConSAT) , allows 
for students to produce graphic structural representations directly, 
which eliminates the need for statistical procedures to transform 
data from raw form to graphic form* The advantages of the technique 
are: (1) having the ability to search for relations between concepts; 
(2) the ability to analyze structural changes of individuals 
resulting from instruction: and (3) the ability to search for the 
integration of more than one kind of structure. (Author/SA) 
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a 

■ Knowledge structures, tne information-processing terra for organized 
networks of information stored in semantic or long-term memory, have 
received muc^t atteation in recent years botn from researcners who. study 
the structure of human memory ( e.g. . Bower, 19T5; Kintsch, ana 
from tnose who explore the role of Knowledge structures in the learning 
of academic subject matter , Greeho, 1976; Snavelson and itanton, . 

1975). 

In the case of the former group, current studies of how Knowledge 
is represented in semantic raeraory include such work as the study of how 
kcnowl^age of geometry is represented (Greeno, 19 "rD, how stories are 
represented (Ruraelhart, 1975), and how various types of simple and 
complex problems are represented and solved (Newell and Siinon, 1972; 
Qreeno,' 1973). Drawing on this growing body of tneory and erapirioai 
woric, reserrcners in the latter group have attempted to develop measures 
of knowledge structures, to trace changes in structure as a result of 
instruction, and to . explore the relationship between . knowledge 
structures and problem solving. 

In a vein similar to the second of these research thrusts, the 
rcsear'«h we report here calls upon information-processing psychology tor 
notions that may suggest possible fruitful relationships to explore 
between Knowledge structures and issues of Instructional import, 
particular, v^c have investJigated the relationship between stuaonts* 
structuring ability and their success In solving verbal academic 



.problems. ^ 

\ .a 

•. 

Ttte link we perceive between knowledge structures and success in 
solving verbal academic problems is suggefited in the speculations of 
Greeno (1976) on the nature of knowledge structures • and cognitive 
processes involved in solving problems. Greeno (1973) -has proposed tnat 
in semantic memory two kind of knowledge are stored, prepositional and 
algorithmic' Prepositional knowledge refers to concepts and the 
relations between them, structures sometimes- thought of as concept 
networks. Algorithmic knowledge "is in the form of operations or rules" 
and., "translates readily.^-r^'P action" (p. 114). A parallel distinction, 
is made by oacerdoti (1977) who uses the terms declarative (for 
prepositional) and procedural (for algorithmic) knowledge, and both 
conceptualizations touch base with our present research since they point 
to two possible major components of problem- solving performance. 

in a more recent publication, Greeno* ( 197f>) describe^ \ typology of 
problem-solving skills that contains three major categories: problems 
of inducing structure, of transformation, and of arrangement. Of 

t » 

•J 

particular importance to our work is his discussion of problems of 
Inducing structure, a prototypical example being. verbal analogies of the 
sort, A is. ^ ^ .aa it is. ifi. Ji. Greeno proposes that the processes in 
solving analogies and similar induction problems are closely analogous 
to the processes involved in understanding language ( e.g:. . fcextj . In 
each case it is postulated that an individual must identify relations 
between components (concepts) and then combine them into integrat^a 
patterns .\ Altnough he does not discuss these processes in terms of nis 
proposition^l/algorithraic distinction, we believe it .is accurate to 



Interpret nis supposition as a pi'-^iira that in both cases the individual 
must consCruct' a propositional icnowledge structure. Greeno further - 
proposes that solving analogies is more difficult tnan understanding a 
sentence, since the relations must be induced in tne case of analogies 
problems. " • \ 

With respect/ to research c<|)ncerne(i with - relating' measures of 
. knowled?;6 structures and ^problem '^olving, G'reeno^s formulation suggests 
that inaiviauals who are better^ sJructurers- of knowledge should be more 
successful solvers of analogies and similar types of problems. What is 
required" to study this implication is a technique tnat both adequately 
represents knowledge structures in school subject matters and monitors 
cna'hges in structures as a result of instruction. Also needed is a 

procedure for reliably distinguishing between highly cor^petent ana less 

*/ 

competent structurers. ■ * • 

« .. . . 

The most popular techniques investigators have used to probe 
Knowledge structures continue to be variations of word association and 
• similarity-rating taSKS (^j^,inaveison, 19/'+; Preece, 1v76a).. 
Graph-tree construction and card-sort tasks (iLuS-t.. onaveison, 
more recent auditions r can be classed as similarity rating prooeaures. 
Tnc essential cnaracteristic of all these tasKs is that subjects lin>< 
concepts, usually words. Instructions may direct subjects to generate 
words upon presentation of a "stimulus" term or to relate terms on the 
oasis of their almilarity. Only in tne graph-trc-c construction" 
proceoure do subjects connect large numbers of concepts in one 
nicrarcnicai' structure.' Caro-sort ^ask instructions gtneraiiy aSiv 
suDj<jots to place similar terms into groups. 



Transforming the. raw daca into a «;raphic representation of 
structure nas often been the aim of researoh^rs, who have employ^id 
various techniques including multidicaensionai scaling (fioiU) oaavelaon, 
197H; Preece, 1976a), hierarouical ciuster?ing, and l^aern' s graphing 
procedure (see Preece,, 1976a:). Tnese statistical procedures, which 
yield group structures, have- been the subject of criticism for the 
assumptions chey make about the "underlying" structure of Knowledge, for 
the reasonableness of statistical assumptions that must be satisfied, 
and for their reliance on "eyeballing" the visual representations a.s the 
last step of the analysis- (see Eignor, 1973). 

The tecnnique \yo have ueveloped to prob«3 knov^iedge structures and 
analyze the representations is an ' extension of the card-Jjort method 
Described by ihavolson and itanton (1975). in their valioation stuay of 
tnree rdethoaologies for representing knowleage structures. However, our- 
approacn, called the QsRcept i;itructure ii^iaiysis X*2chnique (ConiAT), 
differs in several respects froa the card-sort proceaure ana subsequent 
statistical analyses. 'with the Con^iAT, students produce grapnic 
structural representations directly, tnus eliminating tne necessity of 
using stavi^tical procedures. to transform raw data into a graphic form. 

0 

Also, structures of individuals are repf-esented , relations between 
concepts as well as associations between thera are probed, and tne 
inttgracion of more thah one kind of structure can be" represented' ana 
ant .yzed. otuoent structures can tneh be compared with a "standard", 
students who are competent structurers can be iuentifieu, and tne 
relationsnip between the ability to structure and success in solving 
problems of inducing structure can be ^investigated. 



T(\e study was carried out in a sectarian elementary school locatea 
in a large city. The school' s approximaoely HOO students in grades K 
through b come frota middle class homes in the immediate neighborhood. 
Tne science teacher selected 30 students, 17 female and IS male, from 
tne eighth grade classes to' participate in the study. -All students were 
familiar with- the mechanics of using the s^-lf- instructional materials 
used in the study, since they had previously studied sciencfe units in 
the JMilidiialui^ ^gUflQg program from which the"-^i( .ructional 
materials w<?re dravvn. None oT the students had previously i^eceived 
instruct seology. . ' - 

haterials 

Tne instructional materials used in this research, developed by the 
authors of this paper, deal with the ^subject of minerals and rocKS, and 
consist of a segment of the field-testing version of the Lyell Unit of 
the Individualized i^iiifiliaa program (Champagne and Klopfer, 19/4, 
1972-1975). The Lyell Unit includes aspect*? of descriptive, historical, 
and physical geology. The Invitaton to Explore (ITii) Minerals and Hocks 
is primarily descriptive geology.'" The student's booklet for the ITt, is 
^7 typewritten pages long, and consists of reaaing text, manipulative 
activities, and student self-administered progress tests'. On the 
average, a student completes the ITt; in three to^four wecKS witn five 
45-minute periods per week. 



Tne «ITc. Minerals and hocks was designed to incorporate struct J^al 

oiogy. Tne' Structural 
relations include hierarchical class- inclusion, transformational, ana 
definitional relations. The ITfi is organized, in .part, around the 
definition of a mineral, and the taxonomio classificaton of rocKS. ' The^ 
two most important structural relations, one hierarchical and tne other 
transformational, are the classification of roCKS on the basis of how 
they form and tne rock cycle through . which each of three kinds of 
rocx — igneous, metaraorphic, sedimentary— can be transformed .into either 
of the other kinds . 

Tne lib begins by setting a structural context for the studtnt. 

The content structure, is described in the text and is represented 

visually with a- drawing that illustrates both the ftiefarcnical 

relationships among major concepts and examples of tne concepts. . The 

o 

introductory narrative summarizes these relations, which are elaborated 
on throughout the text of 6he ITii. Transformational relations are 
anctner major structural feature represented in tne text of the ITii. 

The diagram below indicates the. sequence of steps .1 tne study. 

i , 

Concept Concept- 
structuring >Fretest >instruction >Postt€St >structuring 

task tasK 



features of the content .of descriptive,x«gLe 



K 
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"Jfirst, we administered pre-instructional concept structuring, tasks. 
These tasks .probed for structural knowledge about the concepts of 
descriptive geology ih our instructional materials. The students then 
took' a pretest on science content contained in the materials. Tnird, 
the students received four weeks of instruction using the '1T£ Minerals 
and Hocks. Instruction was followed by a posttest, almost identical 
with tne pretest, and concept structuring tasks, wnich were the same as 
the ones aaministered before it^truction. The study wa^ carried out 
oyer a period of six weeKs, with one week before and after instruction 
for aaministering the concept structuring tasKs. 

. "0 

\ ■ 

.The pr^-. ana post-tests were divided dnto three parts: a 
multiple-choice item test covering the science content of the ITc-; ah 
analogies items test using key terms used in the instruclional materials 

r a.g. f seasheil is to . as liafflaosi' is to fiacJjflJi: (l )natural, 

(2)caicium carbonate [correct choice], (3)moiecuie, (4)&tomi and. a 
set-members'hip items "test where eadn item contains a set of four terms, 
one of which the student had to identify as not belonging to the • set 
( e.g.. . Cross out the word that does belong with the otner three: 
lava limestone sandstone shale). The pre- .and post-tests 'differed 
only in Part I, which contained ^5 responses on the pre- test and 
additional responses on the post-test. These tests were aaministered by 

f o 

tne classroom teacher. , . ^ 

Thr concept structuring tasks were administered in three parts. 
The^ first part probed students' knowledge structures of prerequisite 
science concepts, i.e. . concepts the designers presumed students 
comprehended 3M which were necessary for comprehension of tne science 

9 



content, in the ITcl Minerals " and Rooks. -The second part probed 
structural ' knowledge of minerals, and the third, part- concerned 
Structural knowledge of rocks* For each task, we used a different . set 
of cards on which the concepts'' were printed. 

» 

The concept structuring tasks were individaaUy-^administered in the 
following manner. Each student was told the purpose of the study atnd 

c 

was then led tnrough 'a practice task that' consisted of cards containing 
familiar anatomical terms. The tferms included in each set are listed in 
Figure' .1 under tneir respective hea<?ings: practice tasn, '>T0« task, 
MlNtiRAL task, and ROCK task. For both the practice task and each 
.succeeding task, the student was shown the set of cards and asked if she- 
recognizea each term in the set. Then, using the recognized terms? the 
student was told that the object of the ta^,. was to arrange the cards in 
a way tnat would show "how you think about the words." The arrangement 
was ^aid out on a large piece of' paper (28 x.41 cm) and tne cards, wnich 
had an adhesive on their rever'se sides, were pressed into place. Tne 

I 

Student was then asked to explain why he or she^ arranged the words in 
this particular way. The responses were recorded by drawing lines on 
the paper between cards designated by the studejj^t and writing in the 
relations between words as described by the student. The^ procedure for 
administering the concept structuring task was the same before and after 
instruction t except that it was unnecessary to conduct the practice task 
on the post-instructionai administration* 

* \ 
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. , INSERT FIGURE 1 ABOUT HEHE 

■ \. • 
\/ 

Analysis of Knowledge Structure Representatiohs 

*' ■ ■' 

The method we . devised for analyzing the data depends on 
'ascertaining the degree of correspondence between student^' structures 
and a standard structure. For this study, congruence be"^ween student 
knowledge structures and content structure is determined by comparing 
• certain characteristics of the representations of • student knowledge 
structures with those of a theoretically derived standard str^Ucture'. In 
deriving the standard structure, we assumed (a) that the scientific 
writings of experts in a field sere represent?ations of the content 
structure Of that discipline, and (b) that ir\ some way or ways, the 
structure of the discipline is congruent with knowledge structures of 
experts, since the" way experts write about _a subject must reflect to 
some degree how they think about the subject (iojSj., writing reflects 
knowledge structure). Thus, to obtain a representation of the content 
s'feructure of the discipline two alternatives are available: (D to 
empirically obtain repihesentations of knowledge structures of a -number 
of people Knowledgeable in a field and identify characteristics common 
to them, or .(2) t.a-consuit tne writings of 'experts and derive the 
s|/ructu#es of the discipline based on the above assumptions. An example 
pertinent to our study is the representation of the structure of tne 
discipline of geology in materials written by experts in the fiela. 
Geologists tend to write (and thini<) about rocks in a way bnat shows 
that rocKS are classified on the basis of a transformational cycle. 



When- a" geolpsiijt (or any scientist.) classifies objects in accor^dance 

with . the prevailing ideas of the science discipline, he or she is doing 

much more than sorting things into groups. The particular scheme of 

classification that is commonly used- by the practitioners of a scier ;e 

at a giveh time reflects the principal theory .or beliefs' concerning ^tne 

scienoe^s domain' at that time* As a-science evolVes and its theories 

Change, the cnanges are Veflected 'in a revised, classification scheme for 

rocks. iNhen' tne kndwledge structure of an expert displays three 

principal groups— igneous, metaraorphic,« sedimentary^- lit displays-at the 

same time mucn oX. the current theory, i.e. /H:he. conceptual structure, of 

pnyaical geology.. \Uther . possible schemes for classification could be 

based, foi?. example, on the physical characteristics of the samples "or on 

their chemioal composition" as well as mqr^e conceptually on the way in 

wnich they were formed. Any on'e'of these -schemes could be equally valid 

^> ♦ 

• ? . * 

if it suited, the particlilar purpose for classifying tne samples* ,The 

knowledge structure as derived from scientific writirigs about geology 

ar'e' important in our analysis Qf^ student knowliedge structures. 

■I , ■ • 

• ' The degree of -correspondence between student and standard 
structures is ascertained by assessing the extent to *which certain 
crucial attributes of the standard structure are present in the studeht 
structure. First, from a careful analysis of the standard structure,^ we 

prepare qualitative .descriptions of the'crucial attributes it exnibits. 

.. \ » 

Tnen . we search the student structure for the attributes and, ae^jending 
on whetaer thej^^^are present or absent, we a^ssign the stiioent sx-ruotun 
to one of several structure classes* These structure classes, v^nion are 
defined chiefly on the basis of the crucial attributes of th^ standard 
structure, arc^ arranged ;Ln q^rclgr of increasing complexity, in tne 



lowest structure class', the organizing attribute is simply some 
graphemic propsrty common to the words .themselves, fon" example, the 
common "-iJtjSL" ending for names 'of minerals. In the more complex 
classes,. tne words are treated as concepts, an<i it. is the concepts which 
are structured accord ins'E^o various attributes that relate thorn, A 
ditTerent serici, of structure' classes has to be defined, of course, for 

' ■ • ' \ ■ 

every set of concepts presented in a concept structuring task. 

. ' - ■ ■ \ 

For both, the fljSCK and MINERAL concepts Which ■ were used in our 
structurir? tasks, we carried, out analyses of the knowledge structure 
representations as just outlined. A detailed description of how we 

■ . . ' 

analyzed ttve ROCK concepts and de-fined the hOCK structure classes is' 
giveji in Champagne al (Note 1), Fr6ra th'at analysjLs, we reproduce 
here tne. standard structure for the HOCK concepts (Figure 2) and the 
'chart summarizing the ^ROCK structure classes (Figure "B). The analysis 



of> the MINERAL c6ncepts is given in the following paragraphs-. 

,>■■'■■ 



INiEHT FIGURES 2 and^ 3- ABOUT HERE 



MINERAL Structuring Task 



Given "the words and phrases of the MLNEHAL concepts structuring 
task, (see Figure jf, tne def initiqjj^of a mineral provides one major 
structure. Mineral class membership and non-membersh'ip relations form a 
second structure. Both of these structures are shown in Figure 4. The 
hierarchical relations that exist^etween a specif ip kind of ^'ock, tne 
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minerals of wnich the took is comoosed, arc! the minerals' cneraicaJ. 
compositions, expressed using both a 'chomical name ^ (e.g. . calcium 
carbonane) and a chemical formula ( ^.gf > GaC03), define a third 
structure (see Figure 5). Although this struot^e is designafed 
"hierarchical," it should be noted thSv it is composed of two . different 
relations. Limestone phvaically contains calcite crystals. Calcite 
"contains" calcium carbonate in the seHse that, upon chemical analysis, 
the mineral calcite will be found to consist, of calcium' carbonado,' which 
is presumed to mean m oleoules of calcium carbonate. 



INSERT FlGURiSS- 4 and 5 ABOUT KfiftE 

1 



The structure in B'igure 6 is representation reflecting tne 
chemical . relationships among the words, as contrasted with the 
geological relationships -represented in Figure 5. Note particularly 
that from a chemical perspective, calcite, limestone, and sea shells are 
roughly analogous, while geologically they are quite distinct. Figure 7 
depicts graphically how the chemical properties of several substarices 
are compared with tne properties that define tne characteristics of 
minerals to determine whether or not the substance in question is a 
mineral . ' 

/I 
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The integration «of the six structures shown in Figures '4 througn 7 
into one standaid structure is somewhat easier to pei-form "in the head" 
tnan on pap%r. As v;e have done it (Figure 8), many of thb subtleties of 
the six separate structures are no longer evident. Nevertheless, tnis 
integrated structure does depict all the essential relationships shown 
in the separate structures and, therefore, can serve satisfactorily as 
the standard structure. By analyzing this standard . structure, we can 
identify the crucial attributes exhibited in it . and prepare a.- 
qualitative description of these. Using the ..descriptions of the 
attributes, we designate a series of structure classes for the MIwbRAL 
concepts structuring task. A summary of these MINERAL . structuring 
classes is shown in the 6hart of Figure 9. This chart is similar in 
form to tne one shown in Figure 5 for the hOCK structure classes, and 
tne function which the two charts serve for , us is the same. 



INSERT FIGURES 8 and 9 ABOUT HERE 



Identification of High- and LoW-Structuring Groups 

The main puribose of our '^analysis of knowledge structure 
representations is to establish a means by wnich "high" structuring 
st:udents and "low"' structuring students can be identified. Once a 
series of structure classes has been designated for a set of concepts, ^ 
we oan use the descriptions of the classes to decide which attributes 
student structures must display to classify them ^is nigh or low 
structurers. Since two series of structure classes were constructed, 



one for the ROCK concepts (Figure 3) and another, for the MIwiiHAL 
concepts (Figure 9), corresponding :high- ana low-structuring groups were 
identified. 

For the HOCK concepts structuring tasK, high structurers were those 
students whose structures displayed attributes equal to or greater than 
tho.se of class W-5 on the ROCK structure ciassec (see Figure 3). The 
critftrion for low structurers was a rating Jess than or equal to class 
W-b on the post-instructional ROCK task and a rating of l-^ss-ttran "class 
W-i on the pre-instructional ROCK task. 

"TpFThe Tllh ERArijo^^^ ~t ask '^Yy"~™™- • g t iid e n t who se. 

KINiLRAL structure was rated as class W-5 or W-6 (see Figure 9) on the 
pre- or. post-tasJc was designsited as a high structurer. a student who 
was rated as class \*-3 or lower on both the pre* and post-task was 
aesignated as a low structurer. 

Since we had little reason to expect that success, at structuring 
concepts- in our tasKS wpiild depend to ^ significant extent on content 
specific characteristics, we decided against splitting the sample into 
the subgroupi'ngs, high-high, high-low, low-high, and low-low. 

Analyses of Scores and Items 

The three parts of the written test we aaministered before and 
after instruction yielded scores for each student's performance on items 
testing for geology ;<nowledge (part V) ■ and on two kinds of verbal 
p^obleui items, analogies (part 2) and set-memberslrjip (part :>). we also 
obtained each student's l.Q. score, based on a recent administration of 
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the Oti3-Lennon Mental ' Abilities Test, For every score, the usu<il 

f " 

aescriptive statistics were calculateU for the total group of students, 
as well as the product-moment correlations betvgeen every pair of scores. 
Using a t-test for correlated groups, we tested the significance of the 
difference between- the means before and after instruction on each score. 
The same sequence of analyses was repeated four times: for students who, 
were identified for the high^struoturing group on the basis of the HQCK 
concepts structuring task, for. students who were so identified for the 
low-structuring group, and for tne high~ and low structuring groups of 
students identified on the basis of 'the MIWEftAL ' concepts structuring 
task. Using a t~test for i^ndependent groups, we. tested the significance" 
of tne difference between the means of the high- and low-structuring 
groups on each score, ' 

Results ^ 

Pre- to Post-Instructional Changes in Scores 

In this and the following two sections, we present the results of 
analyses of nine score variables, lia^ 

Ss.glQ.5y. Knowledge itajaa—consisting of items administered' both 
before and after instruction to test the students* Knowledge of the 
geology subject matter in the ITc: Minerals and Rocks; maxiiaum 
possible scores 45 ' 

Variable 1 - pre-instructionai score 
Variable 2 '- post instructional score 
iSfifliaai. ismXs^ ifijisjint.— percentage of correct responses on tne 
geology knowledge pretest with a total of M5 points and on tne 
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geology Knowledge posttest with a total of 62 points; maximum 
possible score:' 100 . ' " 

Variable 3 - Pre-instructional score 
Variable H - Post-insttructionftl score 
itfiBLl'^'-maximum po^^ score: 17 



V&riable 5 - Pre-instructional score 
Variable 6 - Post-instructional score 
Set-Membership Items— maximum- possible sc^re: 12 



J. Variable 7 - Pre-instructional score 
Variable 3 -Post -instructional score 

i^^f^: Variable 9 

\> ■ ^ . ' 

^ ' ' ' *^ ■ . ' 

Fpr eacir^, of the nine variables 'just descril^d, the means and 
standard errors for all 30 students in the study are presented in Table 
U This table also shows the pre- to post-instructional changes in mean 
scores on Geology Knowledge Items, Geology Knowledge Percent, analogies 
items, and set-membership items. The statistical significance, of each 
of these changes was tested using a t-tcst'fof borrelated means, and the 
results of these tests also are shown in Table 1.' We found that the 
7pi^'='~"^tG ~ post-instructional gains in means scores were stat^istically 
significant (p<.01) for Geology Knowledge Items, Geology Knowledge 
Percent, and analogies items, but. there was not a significant gai'n at 
the .05 lev6l fOFithe set-membership items. 



INoEHT TABLE 1 ABOUT hEHbi 
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Comparisons of high- and Low-cJtructuring Groups • . ^ 

As desoribed in the discussion of our methods of analysis, we- 
idencified 10 students in the high-structuring group and. 12 students in 
the low-structuring group on the basis of the HOCK concepts s.tructur4>ng 
tasK. Prior to instruction, the more competent structiirers recognized a 
far greater number of terms on both r ttie. ROCK and MltjiERAL doncepts 
3tr\'cturing tasks than did the less competent structurerSi Frequency 
counts of unrecognized, terms for both structuring groups on eacn~ tasK, 
(prior to instruction as well as after instruction) appear in Table 2. 
Furtner examination of Table 2 shows that the- " pre-instructional 
difference between high- and low-structuring groups in unrecognized 
terms has largely disappeared by the end of instruction^ The means, and .- 
standard errors for all nine variables listed above^' for the twd groups 
are presented in'Table 3. Tnis table also shows 'the results of tne 
t-test used to •• test "the statistical significance of pre- to ' 
post-instructional cnanges in mean scores. < ' 



INSbRT TABLES _ 2_AND J\ABOUT HERE 



Tne statistical' s'ignifi' ance of the diff(!rence between tne means on 
each variable for ttie high- and low-struc,tur'.ng groups was' tested using 
a t-test for. independent . means. The. results of the'se tests are. 
presented in Table 4. Using these results' and those shown in Table 3i . 
we can compare the several scores obtained by " the high- ana 
low-structuring groups that we identified from tne ROCK concepts^ 
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structuring task. 



INSERT TABLE 4 ABOUT riEfiE 



Before instruction the high-structuring group performed better than 
the low-structuring group (difference between means significant at the 
.05 level) in both the Geology' Knowledge Items and Geology ^Knowledge 
Percent scores. For both scores the- pre- to "post- instructional gains in . 
the means were statistically significant for both groups. However, tne 
post-insjbructional differences between the means for both the Geology 
Knowledge Items^aYid--veercent bcores" for the . two groups are not 
statistically significant- (p>. 1) We ^^bserve a similar result for the 
analogies items score. Here the high-structurifis-^- group's •• 
prc-instructural mean is significantly higner (p<.Ol) than the mean of \ 
the low-structuring group. ,The latter group's pre- io post-test gain is 
statistically significant (p<.01) while the high-structuring group's 
gain is not, and the post- inst rue tioiial d ifference betwe en the means of 
the two groups on the analogies items'is not statistically significant 

at the .05 level . ^ . . 

■ j 

The high-structuring group also outperformed the low-struccurins 
group on the set-membership items 3cor,fj before instruction .(difference ^ 
between means significant at the .05 level). Here, however, the pre-, to 
post-in^Jtructional gain 'Was statistically significant (p<.05) for the 
high-structuring group while th6 low-structuring group did .not gain. 
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1 

% . ■ 

Tne . post- instructional difference between the means of the two groups on 

the set-raenibership items is significant at the ^01 level i Finally, the 

difference , between the c'wo groups' means on the l^Ci, score is 

significant at the .05 level. "... 

In addition to designating high- and low-structuring groups of 
students on. the basis of the ROCK concepts structuring task, we also 
employed the student response structure from- the MINERAL concepts 
structuring task to identify high and low groups- Using the criteria 



described in the discussion of our methods of analysis, we identified 9 
students in the high- structuring group and 10 students in the 

•^low-5^truo-tuF4ng-" groti{)~on~the--bas-is~-of-~th«"--^^^^ — eonee!>bs — -s-truet-uri-ng- 



task. Of these 9 high-atructuring group students, 5 also were ^members 
of the .high-structuring group of ROCK concepts, and of " the .10 
low-structuring groUp students on MINERAL concepts, 7 also were in the 
low-structuring group on ROCK concepts. While the overlap in membership 
of th(5i high- " and low^-s'tructuring groups based on ^he two concepts 
structuring tasks is considerable, the 'Performance of the high and low 
groups on MINERAL concepts was somewhat different from tne high a.hd low 
groujps of ROCK concepts on the nine variables for which scores were 



obtained . 

In Table 5 we present the means, and standard errors for all nine 
variables ' and the significance tests for pre- to post- instructional 
chan^^in means scores of the high- and low-structuring groups on the 
;,basis of\^ MINERAL concepts structuring task. Table 6 shows tne 
siginificance te^ts for the difference between the means on eacn 
variable for the hi^ and low-structuring groups. 
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INSERT TABLES 5 AND 6 ABOUT HEftE 



The first four lines of Table 6 show' that the means of the 
high-sjtructuring group for both the Geology Knowledge items and Geology 
Knowledg'^ Percent scores were higher than the means of the 
low-structuring group both before and after ins true tic but neither 
difference is statistically significant (p>.1^ on either occasion. . 
Nevertheless, as Table 5 shows, both groups mide statistically 
"srpriTit:'ant~pr^"W"p^^^^^ means " scores for both 

Geology Knowledge Items and Geology Knowledge Percent . Both groups also 
maae statilsticaHy significant gains in the means for the analogies, 
items scores from before to af£er instruction, however, we see^in Table 
6 tnat the difference between the means of high- and low- structuring 
groups for the analogies items" 'scores is not statistically significant 
at th? .05 level either before or after instruction. ' 

'•• 

For the set-raembership8.itera> scores, the difference between the 
"means, "of ~~~the high- '-^i^ fo w^s t rue t url ng groups is statistlcaiiy 
significant (p<.01) before instruction, as well as after instruction. 
Tne " pre- to - post-instructional . gain in the mean score, of the 
high-structuring group ia significant at the .05 level, but there, is no 
cnange in the mean score of the , low-structuring group. Finai;y, 
comparing the mean I.Q., scores of the- high- and low-structurir^ groups 
based on the MINERAL concepts structuring task,^ we see that their 
difference is not statistically significano (p>.1). 
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Summary of Score Comparisons 

The tnree pre^- to post- instructional gains in mean scores which are 
statistically' significant for the total group (Table 1)^ also are 
statistically significant for each high- and iow-structuying. group 
(Tables. 3 and 5), whether identified on the baisis of the ROCK concepts 
or the MINERAL concepts structuring task. Thus, improvement from before 
to after instruction was. made in the Geology Khowledge^/lteras, Geology 
Knowledge Percent, and analogies items scores /for both the 
high-structuring and low-structuring, students. The, findings . are 
different, however, for the set-membership items sconfe. Here, the pre- 
to pc ;t- ins trtictip'nal gains in mean scores are statistically significant' 
for the high-structuring. s£udents, identified by, either set of cpncepts, 
but no statistically significant ■ improvement is shown by. the 
low-Structuring students. . ' , . 

0 

y«6 also have four mean scores that compare high- and 



low-structuring students' success in solving verbal problems, wnen tne 
groups are identified on the basis , of the" MINJifiAL concepts structuring 
task, .the high-structuring group performs significantly better than the 

TTo^^^Ts^Tu^ttifW — en--tiie- 
set-membership items before and after instruction (Table 6). We also 
note in Tables 4 and 6 that in those instances where the mean score of 
the high-structuring group on the analogies or set-membership items is 
not significantly different at the .05 Itvel from the mean Score of the 
low-structuring ' groups the observed difference does approach, this level 

. of statistical significance, The probability of obtaining a t-vaiue as 
large as the one calculated is less than .10 in eaoh of these Instances. 
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All In ally the comparisons of mean scores provide some positive 
evidence that students identified as being in a high-structuring group 
are more successful in' ' solving verbal problems than students in a 
low-structuring group. 

0 Discussion 

& . • - . .. 

The results of this e^'^udy suggest that students who are more 
competent struoturers,^ as identified by applying the ConSAl, tend to be 
more successful than less competent structurers in solving problems in 
which they must induce structures. Students' .performance on 
set-membership items, where the difference between the means for' the 
more and less competent structurers was statistically significant at the 
•01 level, supplies the most clear eviaence' for this interpretation. 
The results for the analogies items also contribute to ^' this 
interpretation. On analogies items, the ift^^re competent structurers in 
the HOCK ' concepts structuring tasks outperformed tng less competent 
struc,turers prior to instruction (p<.05), and in the three remaining 
instances (post-instruction for the ROCK task gr^oups, and pre- and 
post-instruction for the MINERAL . t.ask groups), the statistical tests of 
the differences between means on analogies approached the .05 
significance level. • ' 

Two pieces of evidence suggest that, wnile the more competent 

".1. 

Structurers may, have had more concepts committed to memory bo'fore 
instruction, this .advantage has disappeared after instruction. 
Indicative of tnis pre-to-post trend are the observed frequencies bf 
unrecognised terms ,( see laule 2), as well as the Ueology Knowledge iteni 
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results, wtiere no significant difference between the more competent and 
the less competent structurers was observed after instrucfilon. Thus, 
after, instruction the two groups appear to be working ^pom essentially 

the same base set of concepts. - If one pictures a cgpSept network as a 

^ ■p . 

set of nodes and relationships between 0e nodes, a plausibJ.e 
interpretation of these results is that the memory of both groups of 
structurers contained very similar sets. of nodes-. 

Instruction may have had an additional influence on students that . 
helps to explain why the differences between the more competent and the 
less, competent Structurers are more evident on the set-memb§rship items. 
We tentatively hypothesize that set-membership items are mor? difficult 
to process than analogies items since ti\e solution of a set-*m^mbership 
Itfn must be ^attained with fewer ."clues". Since the instructional 
materials were designed to emphasize certain strlictural principles of 
geology explicitly, • we ^ belifeve it is reasonable to conjecture that 

"instruction/ so .designed off set"s to. some degree the advantage which the 

■■ ■ ■ ' ' ' • ,1 * 

> 

more competent structurers bring to the problem-solving task. Thus, on 
problems whose solutions call upon a. greater ability to induce • 
structures, the difference between, the '^more ahd less competent 
Structurers would "b^rcome^tnore- apparentv- The"^ 
Shavelson^s (1973) contention that students who are better problem * 
3olvers following instruction form conceptual networws more readiljr than 
those who are poorer problem solvers ♦ We feel, though, that our results 

tease out the relationship more clearly since in our case, the nature of 

f« . 

the problem tasks was specified to a fi,ner degree. 



That tne ConSAT differentiates students more on the basis of stabler 
individual characteristics than ■ on content specific attribute^ is 
indicated by our finding that c^nly two students who were desl^gnated high 
on the basis of .ibne grouping were low oh -the other . Five students were- 
high on the basis of both the MINERAL and thc-flOCK concept structuring 
tasks, seven' were low on both, and the .remainder were a combination 
either of high and medium or of low an4 medium. Contributing to this 
interpretation , is our observation, described in a p^^evf^*«s report (Note • 
1), that less competent structurers otKpur -geology concept structuring 
tasks were' unable to s^ucture thirtj^erms related to foods.. None was , 

able to generate -a: scheme of classification ap^lipable to all^he foods. 

■' ■ ' ' fi ' ■ ■ . ' . - 

Tney <^ !.uld only „ classi/y foods with which they or members of the irr 

. , ■ ■ Z^' ■ ^ ■ . ■ ' ' ■ '. "1 ■ ' ■ 

immediate family had, had experience, suggesting th at they we re unawa re^— 

of structuring as a sti*ategy for reducing large amounts,,of intormation 

into more ^manageable units. . ^ " ^ 

■ . ■ '■ ' • - ■ , ■ 

Finally, as a procedure for, probing knowledge structures,, certain 

features of the ConSAT recommend its further development. Tne ability 
to probe for relations between concepts, to monitor and analyze 
,-_s.tnuc.rjjirjs^hange:s„j:Lf„..ijaiU-Vj^u^^ of instruction, and„to — 

probe for "the integration of' more than, one kind of structure' are the" 
advantages we perceive. 
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Table 1 



Group and Pre* to Post-Instructional Changes" 



PR£ to POST Changes 





Variable 


Mean 


S.E. 


1 


Geol PRE 


22.30 « 


. 0.80 


2 


Qeoi POST 


.28.43 


1.08 


3 


Geol % PRE 


54.23 


1.95 


A 


' Geol % POST 


63.73. 


2.29 ' 




Analog PRE 


7.J3 


0.47" 


6 


Analog' POST 


9.23 


0.54' 


7 


Set-M PRE 


5.13 


0.29 

7 


8 


Set-M POST 


5.7'J 


0.40 


9 


I.Q. 


109.33 


2.12 



Difference S.E. 



^N»30- 
•4<.i 



+6.13 



+9.60 



+2.10 



^+0.60 



0.88 
1.78 
0.52 
0.31 



6.94 



5;32 



4.04* 



1.92* 



p< .0,1 



Table 2 

Unrecognized Words for Strupturing Groups for Both 
Pre- and Post-Instructional Concept Structuring Task^ 



Pre* 



Post- 



Low 

Rock 
' Mineral 



42 

-53 



2 

ir 



High 
Rock 
Mineral 



10 
18 



P 
0 



ERIC 
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« Table 3 . , 

Means and Standard Errors ot All Variables for the High- and Low-Structuring 
Gi oups on the ROCK Concepts Structuring Task and Pre- to Post- Instructional Changes 

PRE to POST Changes 





Variable 


Mearj" 


S.E. 


Difference 


S.E.. 


t 






High'Striicturing Group on ROCK Cpincepts^ 


r 






Geol PRE 


24.40,, 


1.46 


+5.30 


> 

1 Ai 


« 30** 


2 


■ Geol POST 


29.70 


1.74 








3 . 


sjQUi /u < rib 

c 


59.20 


3>57 


+8.60 


, - 

3.04 


2.82* 


A 


n^nl flkL PHQT 
vJbOI td r\JO 1 

1 


67.80 . 


4.29 








5 


Analog PRE 


.9.40. 


0,48 


+1.00 ^ 


'0.70 


• - 
1.43 


6 


Analog POST 


10.40 


0.81 






t 


7 


Set-M PRE 


6.00,; 


0.36 


+1.40 


0.58 


2.41* 


8 


Set-M POST 


' 7.40 


0.72 








9 


* 


116.30 


3.91 




r 






u 

Low-Structuring Group on ROCK Concepts" 






1 


Geol PRE 


, 20.00 

q 


1.18 


+6.00 


1 3S 


4.45'* 


2 


Geol POST 


26.00 


1,90 ' 








3 


Geol % PRE.^ 48.75 


2.88 / 


+10.83 


2.82 


3.84'* 


4. 


Geol % POST 


59.58 


3.73 








5. 


- Analog PRE- 

J ■ ' 


5.67 


0.72 




0.83 


3.1 1*' 


6 


Analog POST 


8.25 


0.82 








r 


Set-M PRE 


4.42 


0.48 


-0.17 


0.44 


0.38 


•8 


• Set-M POST 


4.25 


0.35 








9 


I.Q. 


104,42 


2.50 









^N»10 
'>N-12 
•p<,OB. 
p<.01 
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' Table 4 . ' , 

Significance of Difference Between Means on Each Variablai for High- and ' 
LoW'Structyring Groups on the ROCK Concepts Structuring Tasl< 





Variable 


Difference 
Between Means 
(High-Low) 


S.E. 


t 


1 


Geol PRE 


440 


1.86 


2.37** . 


2 


Geol POST 


3.70 


c.2.62 


1.41 


3 


Geol % PRE 


10.45 


4.54 


2.30** 


4 


Geol % POST 


8.22 


5.67 


1.45 


5- 


Analog PRE 


-3.73 


0.90 


4.13*** , 




Analog POST 


2.15 . 


1.16 


1.85* 


7 


^t-M PRE 


1.58 


0.63 


2.52* • 


8 

• 


Set-M POST 


3.15 


0.75 


4.16*** 


9 


I.Q. 


11.88 


4.50 


2.64** 



•p<.1 

**p<.05 
••*p<.p1 



3:i 



Table 5 

Means and Standard Errors of All Variables for the High* and Low-Structuring 
Groups on the MINERALS Concepts Structuring Task 

V and Pre* to Post'lnstructlonal changes , - 



PRE to POST Changes 





Variable 


Mean 


S.E. 


Difference .S.E.' 






High Structuring Group on MINERALS Concepts^ 


• 


1 


Geol ?RE 


24.44 


171 














-^5.89 1.13 


5.20** 


2 


Qeol POST 


30.33 


' 1.85 






3 


Geol % PRE 


59.44 


4.12 














+10.56 . 4.35 




4 


Geol % POST 


70.00 


4.08 






5 


Analog PRE 


8.22 


0.76 












+2.78 - 


3.93** 


6 


Anrtlog POST 


11.00 


0.83 






7 


Set-M PRE 


5.89 


* 0.45 














. +1^89 0.61 


3.09* 


8 


Set-M POST 


7.78 


0.76 


1 

1 




9 ' 


' I.Q. 


117.44 


4.08 


l7 ' . 




Low-Structuring Group on MINERALS Concepts" 


1 


Geol PRE 


21.10 


•V 1.53 














+6.50 .1.72, 

M 


. 3.78* • 


2 


Geol PO?T, 


^7.60 


1J.66 




3 


Geol % PRE 


51.40 


3.72 


o * 










+9.40 '2.71 


3.46** 


4 


Geol % POST 


60.80 


4.82- 






5 


Analog PRE 


8.10 


. 0.89 




3.09* 










+2.40 0.78 


6 


Analog POST 


8.50 


0^91 






' 7 


Set-M PRE 


' 4.20 


0,33 






.'t 












. 8 


Set-M POST 


4.20 


0.51 






9 


I.Qr 


108.50 


3.18 






a 


N = 9 










b 


N * 10 








V 



* p < ,05 
••p<,01 
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<'Tdbl« 6 



Significance of Oifferlance Between Means on Each Variable for High- and 
Lo wT Structaring^wup$-on-th»-MtN£B ALS-CpnceptiStructuriog T4stc 



• - 


difference ^ 
Between Means 
Variable (High>Low) 


S.E. 


t 


1 


Geo! PRE -\ 3.34 


2.29 


1.46 


2 


Geol PpST 2.73 


3.29 


6.83 


3 


Geol % PRE « 8.04 


„ 5.54 ^ » 


1.45 




Geol % POST 9.20 


6.39 


1.44 • 


5 


Analog PRE 2.12 


1.18 


1.80* 


6 


Analog P(^ST 2.50 


1.24 


' 2.or ^ 


7 


Set-M PRE 1.69 / ' 


0 0.55 


3.06* • 


(i 


Se,t-M POST . 2.5b/ 


0.90 


3.98** 


9 


' l.Q. 8.94 


5.14'^ 


1.74 



•p<.1 

p<.01 



Practice Task 

^' ■ . 

bbdy heel 

ears metatarsus 

eyes nose 

face ^ -soul^ 

foot toes 



ATOM Task 
atoms 

chemical compounds 
chemical elements 
chemicel substances 
molecules^' * 



ROCK Task 

granite metamorphic 

igneous pumice 

lava rock 

limestone , sediment 

magma sedimentary 

marble shale 
slate 

, . MINERAL Task \ 

C inorganic solid substances 

CaCOj ^ limestone ■ ^ 

calcite mineral 

c^lchjm NaCI 



carbonate 




shells of sea animals' | 

substances with a charadteristic . 
crystalline structure 

substances with a definite 
chemical composition 

i^urally occurring substances 

t^bt^alt 



Figure 1. Words used in the concept structuring tasks. 
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forms 



magma 




rock : 

T 




c/ass or % 





sedimentary , 



forms 



forms 



lava 




metamo?phic 



to^form 



shale 



limestone 




slate 



changes 



sediment 



changes into 



into 




marble 



Figure 2. Integrated structure showing hierarchical and transformation 
relations of the thirteen words in the ROCK task. 
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\ 



.COMPLEXITY OF 
. STRUCTURE 




G 



V)-1 ' W-2 ' ,:W-3 W4 I W-5 



r 

IGraphem^ 
\ (jroup I 



vyords Qroup 



CLASSES OF STRUCTURES'^ 



CLASS 


— '1 ' 

ATTRIBUTES OF THE CLASS 


W-6 


integrdtion of hierarchical structure and trans- 
formational structure into a single structure 




hierarchical structure plus fragment of trans* 
, formatiqnal structure 


W-4 


hierarchical, structure 
structure ^ 


or transformational 


- W-3 

c. 


fragments of the. hierar 
mational stfjiictur^s 


chical and/or transfor- 

V 


W-2 


two or more words related. by a single technical 
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Figure 3. Attributes and cUsses for ROCK structures. 
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Figure 7. Origins of chemical and geological distinctions. 
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